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Abstract 

Second order systems whose drift is defined by the gradient of a given 
potential are considered, and minimization of the L^-norm of the control 
is addressed. An analysis of the extremal flow emphasizes the role of sin¬ 
gular trajectories of order two | 25[I29| : the case of the two-body potential 
is treated in detail. In L^-minimization, regular extremals are associated 
with controls whose norm is bang-bang; in order to assess their optimality 
properties, sufficient conditions are given for broken extremals and related 
to the no-fold conditions of |20| . An example of numerical verification of 
these conditions is proposed on a problem coming from space mechanics. 
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1 Introduction 

This paper is concerned with the optimal control of mechanical systems of the 
following form: 

qit) + VV{qit)) = M{t) =-I3\u{t)\, 

where q is valued in an open subset Q of R’*', m > 2, on which the potential 
V is defined. The second equation describes the variation of the mass, M, of 
the system when a control is used (/3 is some nonnegative constant). The finite 
dimensional norm is Euclidean, 
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and a constraint on the control is assumed, 

|u(t)| < £, £ > 0. (1) 

Given boundary conditions in the n-dimensional state (phase) space X := TQ 
Q X R™ (n = 2m), the problem of interest is the minimization of consumption, 
that is the maximization of the hnal mass M{tf) for a fixed final time. Clearly, 
this amounts to minimizing the L^-norm of the control, 

/ 

|u(t)| dt —min . (2) 

Up to some rescaling, there are actually two cases, /3 = 1 or /3 = 0. In the second 
one, the mass is constant; though maximizing the final mass does not make sense 
anymore, the Lagrange cost (§ is still meaningful. Actually, as propellant is 
only a limited fraction of the total mass, one can expect this idealized constant 
mass model to capture the main features of the original problem. We shall 
henceforth assume /3 = 0, so the state reduces to x := {q, v) with v := q. 

In finite dimensions, .^^-minimization is well-known to generate sparse solu¬ 
tions having a lot of zero components; this fact translates here into the existence 
of subintervals of time where the control vanishes, as is clear when applying the 
maximum principle (see This intuitively goes along well with the idea of 
minimizing consumption: There are privileged values of the state where the 
control is more efficient and should be switched on (burn arcs), while there are 
some others where it should be switched off (cost arcs). (See also [5] for a differ¬ 
ent kind of interpretation in a biological setting, again with L^-minimization.) 
The resulting sparsity of the solution is then tuned by the ratio of the hxed final 
time over the minimum time associated with the boundary conditions: While a 
simple consequence of the form of the dynamics (and of the ball constraint on 
the control) is that the min. time control norm is constant and maximum every¬ 
where for the constant mass modelQ the extra amount of time available allows 
for some optimization that results in the existence of subarcs of the trajectory 
with zero control. (See Proposition in this respect.) A salient peculiarity 
of the infinite dimensional setting is the existence of subarcs with intermediate 
value of the norm of the control, namely singular arcs. This was analyzed in 
the seminal paper of Robbins [25] in the case of the two-body potential, provid¬ 
ing yet another example of the fruitful exchanges between space mechanics and 
optimal control in the early years of both disciplines. The consequence of these 
singular arcs being of order two was further realized by Marchal who studied 
chattering in |I8] : this example comes probably second after the historical one 
of Fuller [12] and has been thoroughly investigated by Zelikin and Borisov in 

[laisDj. 

A typical example of second order controlled system is the restricted three- 
body problem |S] where, in complex notation (R^ ~ C), 

y (. 1-M _ h 

^ ' |q-|-/re**| Ig - (1 -/r)e**| 

In this case, /r is the ratio of the masses of the two primary celestial bodies, in 
circular motion around their common center of mass. The controlled third body 

^See, e.g.^ do); this fact remains true for time minimization if the mass is varied provided 
the mass at final time is left free [ibid]. 
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is a spacecraft gravitating in the potential generated by the two primaries, but 
not influencing their motion. When fj, = 0, the potential is autonomous and one 
retrieves the standard controlled two-body problem. The study of ” continuous” 
(as opposed to impulsive) strategies for the control began in the 60’s; see, e.g., 
the work of Lawden HU, or Beletsky’s book [3] where the importance of low 
thrust (small e in 0 ) to spiral out from a given initial orbit was foreseen. 
There is currently a strong interest for low-thrust missions with, e.g., the Lisa 
Pathfinder HU one of towards the Li Lagrange point of the Sun-Earth 

system, or BepiColombo [4 mission of ESA and JAXi^to Mercury. 

An important issue in optimal control is the ability to verify sufficient op¬ 
timality conditions. In L^-minimization, the first candidates for optimality are 
controls whose norm is bang-bang, switching from zero to the bound prescribed 
by 0 (more complicated situations including singular controls). Second order 
conditions in the bang-bang case have received quite an extensive treatment; 
references include the paper of Sarychev [261, followed by [2] and [IllEllEa]. 
On a similar line, the stronger notion of state optimality was introduced in |24] 
for free final time. More recently, a regularization procedure has been developed 
in m for single-input systems. These papers consider controls valued in poly- 
hedra; the standing assumptions allow to define a finite dimensional accessory 
optimization problem in the switching times only. Then, checking a second or¬ 
der sufficient condition on this auxiliary problem turns to be sufficient to ensure 
strong local optimality of the bang-bang controls. A byproduct of the analy¬ 
sis is that conjugate times, where local optimality is lost, are switching times. 
A different approach, based on Hamilton-Jacobi-Bellman and the method of 
characteristics in optimal control, has been proposed by Noble and Schattler 
in [20]. Their results encompass the case of broken extremals with conjugate 
points occuring at or between switching times. We provide a similar analysis 
by requiring some generalized (with respect to the smooth case) disconjugacy 
condition on the Jacobi fields, and using instead a Hamiltonian point of view 
reminiscent of m [15] . Treating the case of such broken extremals is crucial 
for L^-minimization: As the finite dimensional norm of the control involved in 
the constraint Q and in the cost 0 is an .^^-norm, the control is valued in the 
Euclidean ball of R™, not a polyhedron if m > 1. When m = 1, the situation is 
degenerate, and one can for instance set u = u+ — U-, with u+,u- > 0. (This 
approach also works for m > 1 when an or .^°°-norm is used for the values of 
the control; see, e.g., [28].) When m > 1, it is clear using spherical coordinates 
that although the norm of the control might be bang-bang, the variations of 
the control component on 8"*“^ preclude the reduction to a finite dimensional 
optimization problem. (The same remark holds true for any .^^’-norm of the 
control values with 1 < p < oo.) An example of conjugacy occuring between 
switching times is provided in 0 

The paper is organized as follows. In section the extremal lifts of L^- 
minimizing trajectories are studied for an arbitrary potential in the constant 
mass case; the properties of the flow are encoded by the Poisson structure de¬ 
fined by two Hamiltonians. In section [^ sufficient conditions for strong local 
optimality of broken extremals with regular switching points are given in terms 
of jumps on the Jacobi fields; these conditions are related to the no-fold con- 


^ European Space Agency. 

® Japan Aerospace Exploration Agency. 
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dition of [5D]. In section some numerical results illustrating the verification 
of these sufficient conditions for L^-minimizing trajectories are given. The two- 
body mechanical potential is considered, completing the study of Gergaud and 
Haberkorn [13] where the first numerical computation of fuel minimizing con¬ 
trols with hundreds of switchings (for low thrust) was performed using a clever 
combination of shooting and homotopy techniques. (See also [H] in the case of 
a few switchings.) The classical construction of fields of extremals in the smooth 
case is reviewed in an appendix. 


2 Singularity analysis of the extremal flow 

By renormalizing the time and the potential, one can assume e = 1 in 0 , so 
we consider the L^-minimum control of 


q{t)-\-\7V{q{t)) = u{t), |u(t)| < 1, 

with x{t) = {q{t),v{t)) G X = TQ {v{t) = q{t)), Q an open subset of R"* 
(to > 2), and make the following assumptions on the boundary conditions: 


a:(0) = xq and x{tf ) G Xf C X 


where (i) Xq does not belong to the terminal submanifold Xj, (ii) is invariant 
wrt. the flow of the drift 




and (iii) the fixed hnal time t/ is supposed strictly greater than the minimum 
time tf{xo,Xf) < oo of the problem. As the cost is not differentiable for u = 0, 
rather than using a non-smooth maximum principle (compare, e.^., [3) we make 
a simple desingularization: In spherical coordinates, u = pw where p G [0,1] and 
u> G the change of coordinates amounts to adding an fiber above 

the singularity u = 0 of the cost. In these coordinates, the dynamics write 


x(t) = Fo(x(t)) + p{t)y^,Wi{t)Fi{x{t)) 

i=l 


with canonical Tj = d/dvi, i = 1,..., to, and the criterion is linearized: 

/ 

p(t) dt —> min . 

The Hamiltonian of the problem is 

m 

H{x,p,p,w) = p°p-G Ho{x,p) + p'^WiilJi{x,p) 

i=l 

where FIq{x,p) := pFq{x) and the 'ipi{x,p) := pFi(x) are the Hamiltonian lifts 
of the Fi, i = 1,..., TO. Readily, H < Hq pHi with 



Hi := p° + 



■^This assumption can be weakened; it is only used to ensure that a time minimizing control 
extended by zero beyond the min. time is admissible. (See Lemma fll) 
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and the equality can always be achieved for some w G 8 ™“^: w = V'/IV'I 
whenever ip := [tpi,... ,'ijjm) is not zero, any w on the sphere otherwise. By 
virtue of the maximum principle, if (p, w) is a measurable minimizing control 
then the associated trajectory is the projection of an integral curve {x,p) : 
[0,tf] —)• T*X of Hq + pHi such that, a.e., 

Ho{x{t),p{t)) -f p{t)Hi{x{t),p{t)) = max Ho{x{t),p{t)) rHi{x{t),p{t)). (3) 

Moreover, the constant p° is nonpositive and (p°,p) ^ (0,0). Either = 0 

(abnormal case), or can be set to —1 by homogeneity (normal case). 

Proposition 1 (Gergaud et al. [13)1. There are no abnormal extremals. 

Lemma 1. The function ip evaluated along an extremal has only isolated zeros. 

Proof. As a function of time when evaluated along an extremal, ip is absolutely 
continous and, a.e. on [ 0 ,t/], 

ipi{t) = p{t)[Fo,Fi]{x{t)), i = l,...,m. 

As a result, ip is a function of time and, if ip{t) = 0, then ip{t) 0; indeed, 
the rank of {Ei,..., [Fg, Fi],..., [Fq, F^]} is maximum everywhere, so p{t) 
would otherwise be zero. Since p is solution of a linear ode, this would imply that 
it vanishes identically; necessarily < 0 , so p would also be zero a.e. because 
of the maximization condition ([^. This is impossible because xq ^ Xf. □ 

Proof of the Proposition. By contradiction: Assume p^ = 0; as ip has only iso¬ 
lated zeros according to the previous lemma, p = 1 a.e. by maximization. The 
resulting cost is equal to tf. Now, the target submanifold Xf is invariant by the 
drift, so any minimizing control extended by u = 0 on (where tf denotes 

the min. time) remains admissible. It has a cost equal to tf < tf, hence the 
contradiction. □ 

We set p^ = —1, so Ffi = \ip\ — 1. In contrast with the minimum time case, 
the singularity ip = 0 does not play any role in L^-minimization. In the neigh¬ 
bourhood of t such that ip{t) = 0, Ffi is negative, so p = 0. Locally, the control 
vanishes and the extremal is smooth. The only effect of the singularity is a 
discontinuity in the fiber over u = 0 in which w{t-\-) = —w{t—) (see [ 10 ) 1 . 

The important remaining singularity is Fti — 0. As opposed to the standard 
single-input case, Ffi is not the lift of a vector field on X; the properties of the 
extremal flow depend on Hq, Hi, and their Poisson brackets. (See also ^for 
the consequences in terms of second order conditions.) We denote by Hqi the 
bracket {Hq,Hi}, and so forth. The following result is standard (see [^, e.g.) 
and accounts for the intertwining of arcs along which p = 0 (labeled 70 ) with 
arcs such that p = 1 (labeled 7 +). 

Proposition 2. In the neighbourhood of zq in {Hi — 0} such that Hqi{zq) ^ 0, 
every extremal is locally bang-bang of the form 707 + or 7 + 70 , depending on the 
sign of Hqi{zq). 
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Proof. As Hqx{zq) ^ 0, Hi must be a submersion at zo, so {Hi = 0} is locally 
a codimension one submanifold splitting T*X into {Hi < 0} and {Hi > 0}. 
Evaluated along an extremal, Hi is a function of time since 

Hi{t) = {Ho + pit)Hi,Hi} = Hoi{t). 

Through Zq passes only one extremal, and it is of the form 7 o 7 + if Hqi(zo) > 0 
{resp. 7 + 7 o if Hoi{zo) < 0). The bracket condition allows to use the implicit 
function theorem to prove that neighbouring extremals also cross {Hi — 0 } 
transversally. □ 

Such switching points are termed regular and are studied in ij^from the point 
of view of second order optimality conditions. Besides the occurence of 70 arcs 
resulting in the parsimony of solutions as explained in the introduction, the 
peculiarity of the control setting is the existence of singular arcs along which 
Hi vanishes identically. On such arcs, p may take arbitrary values in [0,1]. 

Theorem 1 (Robbins |25jl. Singular extremals are at least of order two, and 
minimizing singulars of order two are contained in 

{z = {q,v,pg,py) G T*X I V"{q)pl > 0, V"[q)pl > 0}. 

Proof. One has Hq = {pq\v) — {pv\XV{q)), and Hi — 0 along a singular so, 

0 = Hoi = -j^Apq\pv) 


along the arc. 

Lemma 2. On P^X, Hioi — Hiooi — 0. 

Proof. Computing, 

Hioi = {Hi, Hoi} = {\py\ - l,-j^^{pq\py)} = 0, 
and it is standard that 

^^1001 = {Hi,{Ho,Hoi}} 

= {—Hqi, Hqi} + {Hq, Hioi} 

= 0 

using Leibniz rule. □ 

Then 0 = Hoi = Hooi + pHioi implies i?ooi = 0 along a singular arc. Iterating, 
0 = Hooi = Hoorn + pHiooi so, by the previous lemma again, 0 = i?oooi- 
Eventually, 0 = TIoooi = ^looooi+P-f^ioooi- Set / := Ho, g := Hi, h := -(pqlpv), 
so that Hoi = /3h with /3 = l/|p.u|. Using Leibniz rule, the following is clear. 

(adV)(/?/i)l(ad./)/.=o. 0<,<fc = /3(adV)/i 

{5,(ad''/)(/3/i)}|(ad'/)/i= 0, 0<i<k = A{9, {a.d'" f)h} 


Lemma 3. 
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Computing, one obtains 


(ad/)/i = -V”{q)pl + \pq\^, 
so 0 = i/ooi implies V"{q)pl > 0, and 

(adV)^ = -V"\q){v,py,py) + W" {q){pq,py), 

{g, (adV)M = -T^y'"{q)pl. 

\Pv\ 

Through a point zq such that the last quantity does not vanish, there passes a 
so-called order two singular extremal that is an integral curve of the Hamiltonian 
Hs '■= Hq psHi with the dynamic feedback 

-ffooooi 


Along such a minimizing singular arc, the generalized Legrendre condition must 
hold, -Hioooi < 0, so V"'{q)pl >0. □ 

Corollary 1. In the case of the two-body potential V(q) = — l/l?] {q 7 ^ 0), along 
an order two singular arc one has either a G (7r/2, oq] or a G [— ooj ~'^/2) where 
a is the angle of the control with the radial direction, and oq = acos(l/-\/3). 

Proof. One has 


V'{q)Pv 


{Pv\q) 


V"{q)pl 


\Pv? "^{PvW 

|g|3 |g|5 


V"'{q)p 


3 

V 


%Pv\q)\Pv? lb{py\qf 

kk kr 


On Q = R™\{0}, S'" ^ ^ w = py since |p„| = 1 along a singular arc, so 
COSO = [py\q)/\q\. The condition V"[q)p1 > 0 reads 1 — Scos^a > 0, and 
V'''{q)pl > 0 is fulhlled if and only if 


cos a(3 — 5 cos^ a) < 0 


that is provided cos a < 0 in addition to the previous condition. Hence the two 
cases (in exclusion since the singular control is smooth) for the angle. □ 

The existence of order two singular arcs in the two-body case results in the 
well-known Fuller or chattering phenomenon [HISS]- The same phenomenon 
actually persists for the restricted three body problem as is explained in [50] . 
Altough these singular trajectories are contained in some submanifold of the 
cotangent space with codimension > 1, their existence rules out the possibil¬ 
ity to bound globally the number of switchings of regular extremals described 
by Proposition The next section is devoted to giving sufficient optimality 
conditions for such bang-bang extremals. 
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3 Sufficient conditions for extremals with regu¬ 
lar switchings 

Let X be an open subset of R", U a nonempty subset of R™, / a vector field 
on X parameterized hy u G U, and /° : X x t/ —>■ R a cost function, all smooth. 
Consider the following minimization problem with fixed final time tf: Find 
{x,u) : [0,tf] ^ X X U, X absolutely continous, u measurable and bounded, 
such that 

x{t) = fix{t), u{t)), t e [0, tf] (a.e), 
a;(0)=a;o, x{tf)=xf, 

and such that 

f{x{t),u{t))dt 

is minimized. The maximum principle asserts that, if (x,u) is such a pair, there 
exists an absolutely continuous lift {x,p) : [0,t/] T*X and a nonpositive 
scalar (p°,p) ^ (0,0), such that a.e. on [0,t/] 

f)M f)J-T 

x{t) = —(x{t),p{t),li{t)) , p{t) = - — {x{t),p{t),u{t )), 



and 

H{x{t),p{t),u{t)) = maxH(x(t),p{t),-) 
where H : T* X x U ^ Ris the Hamiltonian of the problem, 
H{x,p,u) :=p°f°{x,u) -\-pf{x,u). 


We first assume that 

(AO) The reference extremal is normal. 

Accordingly, can be set to —1. Let Hi,H 2 : T*X —>■ R be two smooth 
functions, and denote S := {Hi = H 2 }, fli := {Hi > H 2 } (H 2 := {H 2 > Hi}, 
resp.) We assume that 

maxH{z,-) = Hi, z G fli, i = l,2, (4) 

and follow the point of view of m that these two Hamiltonians are competing 
Hamiltonians. Let (x,p,u) be a reference extremal having only one contact 
with E at Zi := z{ti), ti G (0,t/) (z := {x,p)). We denote H 12 = {Hi,H 2 } the 
Poisson bracket of Hi with H 2 and make the following assumption: 

(Al) Hi2{zi) > 0. 

In [15] terms, zi is a regular (or normal) switching point. This condition is 
called the strict bang-bang Legendre condition in [2]. The analysis of this section 
readily extends to a finite number of such switchings. 

Lemma 4. z is the concatenation of the flows of Hi and then H 2 . 
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Proof. The extremal having only one contact with S at zi, z(t) is either in Sli 
or fl 2 for t y^ti- Because of Q, the maximization condition of the maximum 
principle implies that z is given by the flow of either Hi or H 2 on In 

both cases, 

— (i7l - = -Hi2{zi) < 0, 

so Hi > H 2 before ti {H 2 > Hi after h, resp.) and the only possibility is an 
Hi then H 2 concatenation of flows. □ 

As a result of (Al), S is a codimension one submanifold in the nbd of Zi, and 
one can define locally a function zq i-t ti{zo) such that Zi(ti(zo), Zq) belongs to 
S for zo in a nbd of zq := ^(0). As we have just done, we will denote 

Zi(t, zo) = e*^‘(zo), z=l,2, 

the Hamiltonian flows of Hi and i? 2 - These flows will be assumed complete for 
the sake of simplicity. We will denote ' = d/dz for flows. Clearly, 

Lemma 5. 


^i(^o) = ^^^^-^-Ty^^^izi{ti{zo),zo))z[{ti{zo),zo). 

Cl 12 

One then defines locally zq i—>■ z(t,zo) = (x(t, zo),p(t, zq)) := zi(<, zq) if < < 
ti(zo), and z(t, Zq) := Z 2 (t - ti(zo), Zi(ti(zo), Zq)) if t > ti(zo). We recall the 
following standard computation: 

Lemma 6. For t > fi(zo), 

dz 

— (t, Zo) = Z 2 (t-tl(zo),Zi(ti(zo),Zo))(/ + cr(zo))zj(ti(zo),zo) 

OZq 

with 

a{zo) = {zi{ti{zo),Zo)). (5) 

-^12 

Proof. The derivative is equal to (arguments omitted) 


-Z2ti + Z2(ziti + z'l), 

hence the result by factoring out Z 2 and using Lemma plus the fact that the 
adjoint action of a flow is idempotent on its generator, 

(z 2 (s,z))“^/? 2 (-Z 2 (s,z)) = /?2(2), (s, z) S R X T*X. 

□ 


The function 

dx 

S{t) :=det—{t,zo), t^ti, (6) 

is piecewise continuous along the reference extremal, and we make the additional 
assumption that 

(A2) S{t) ^ 0,t G (0,ti) U {ii,tf], and (5(ti+)(5(ti—) > 0. 
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This condition means that we assume disconjugacy on (0,ti] and along 

the linearized flows of Hi and H 2 , respectively, and that the jump (encoded by 
the matrix cr(zo)) in the Jacobi fields is such that there is no sign change in the 
determinant. This is exactly the condition one is able to check numerically by 
computing Jacobi fields (see mm, e.g.). As will be clear from the proof of the 
result below, geometrically this assumption is the no-fold condition of [20] (no 
fold outside ti, no broken fold at ti). 

Theorem 2. Under assumptions (A0)-(A2), the reference trajectory is a 
local minimizer among all trajectories with same endpoints. 

Proof. We proceed in five steps. 

Step 1. According to (A2), dxi/dpij{t,zii) is invertible for t G (0,ti]; one can 
then construct a Lagrangian perturbation .ifg transverse to containing 

zq such that dxi/dzo{t,zo) is invertible for t G [0,ti], t — 0 included, djdzQ 
denoting the n partials wrt. zq G Af’o- (See appendix [^) For e > 0 small enough 
define 


.ifi := {{t,z) G R X T*X \ {3zo G ifo) : t G (-e,ii(zo) + £) s.t. z = zi{t,zo)}. 

By restricting .ifg if necessary, U : R x T*X —R x AT, {t, z) i-G {t, x) induces a 
diffeomorphism of onto its image. Similarly, (A2) implies that 


— [X 2 it - ti{zo), Zi{ti{zo), Zo))] 1 ^ 0=20 

is invertible for t G [ti, t/]; restricting again .jSfo if necessary, one can assume 
that n also induces a diffeomorphism from 

^£2 {(f) z) G R X T*X I (3zo G .^ 0 ) ■ f G (ti(zo) — e,tf ~\- s) 

s.t. z = Z 2 {t - ti(zo),zi(ti(zo),zo))} 

onto its image. 


Step 2. Define Ei := .ifin(RxS). As (f,Zo) i-G- {t,xi{t, zo)) is a diffeomorphism 
from R X .ifp onto n(.jSfi), there exists an inverse function Zo{t,x) such that 
n(Ei) = {'(/) = 0} with 


ip{t,x) :=t- ti{zo{t,x)). 


Denote if{t) := ip{t,x{t)) the evaluation of this function along the reference 
trajectory. By construction, tp{ti—) = 1 > 0 and (compare pp] ) 


dti 


dz( 


dxi 


^/>(ti+) = l + —(zo) ^(fi,zo) Vp(7Ji 


dzn 


H2m). 


Lemma 7. 





dti 

dpo 


(zo) 



Xp{Hi-H2){zi)\. (7) 
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Proof. By virtue of Lemma 

dx . dxi . (Hi — H2 )', dzi _ . 

——(ti+, Zq) = ——(ti, Zo) + Vp(iLi — H2) - — -(^1) Q—(^ 1 ) ^0) 

opi) dpo Hi 2 dpo 

' -V-" 

dti 

‘ iS'"”’ 

(the second equality coming from Lemma[^. Assumption (A2) implies (5(ti—) 
0 so, taking determinants, 


dxi 


S(ti-f) = 5(ti-)det /+ ^(ti,zo) '^p(Hi - H 2 )izi) — (zo) 


dpo 


-1 


dti 


dpo 


dti 


dpo 


dxi 


= 6(ii-) 1 + ^(^o) -7r^{ii,zo) VpiHi - H2)(zi) 


dpo 


as det(/ + x*y) = 1 + (x\y). □ 

Since (5(ti+) and 6{ti—) have the same sign, the quantity in brackets in Q 
must be positive. Accordingly, tp{ti+) > 0 as .ifo can be taken arbitrarily close 
to TfgX. So, locally, n(Ei) is a submanifold that splits R x A in two and, by 
restricting .ifp if necessary, every extremal of the field t !->■ x(t, zq) for zq £ 
crosses n(Si) transversally. Defining 

.iff := {{t,z) G R X T*X \ {3zo G .i^o) : t G [0,ti(zo)] s.t. z = Zi(t,zo)} 


and 

if 2 + := {(t,z) G R X T*X \ (3zo G ifo) : t G [ti{zo),tf] 
s.t. Z = Z 2 (t - ti(zo),zi(ti(zo),zo))}, 

one can hence piece together the restrictions of 11 to .iff and .if2^ into a contin¬ 
uous bijection from iff U if2^ into n(iff U if2^). By restricting to a compact 
neighbourhood of the graph of z, one may assume that 11 induces a homeomor- 
phism on its image. 


Step 3. Denote := pdx — Hi(z)(\t, i = 1,2, the PoincarACartan forms 
associated with Hi and iL 2 , respectively. To prove that ai is exact on ifi, it 
is enough to prove that it is closed. Indeed, if 7 ( 3 ) := (t(s), zi(t(s), zo(s))) is 
a closed curve on if, it retracts continuously on 7 o(s) := ( 0 ,zo(s)) so that, 
provided ai is closed, 


ai 



pdx = 0 


because zo(s) belongs to if that can be chosen such that pda: is exact on it. 
(Compare [U §17].) Similarly, to prove that 02 is exact on if 2 , it suffices to 
prove that it is closed: If 7(5) := (t{s), Z 2 (t(s) — <i(zo(s)), zi(ti(zo(s)), zo(s)))) 
is a closed curve in if 2 , it readily retracts continuously on the curve 71 (s) := 
(ti(zo(s)), Zi(ti(zo(s)), Zo(s))) in Si, which retracts continuously on 7o(s) := 
(0, zo(s)) again. Then, as Hi = H 2 on S, 





9 ^- 



Figure 1: The field of extremals. 


that vanishes as before. To prove that ai is closed, consider tangent vectors at 
(t, z) € Jfi; a parameterization of this tangent space is 

+ z[(t, zo)Szo), (St,Szo) e R X T^gJfo 

where zq S is such that z = zi(t, zq). For two such vectors vi, V2, 

dai(t, z)(vi,V 2 ) = (dp A dx — dHi(z)dt)(vi,V 2 ) 

= dpAdx(z[(t,zo)SzQ,z[(t,zo)SzQ) 

= dp A dx(SzQ,SzQ) 

= 0 
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because exp{tHi) is symplectic and is Lagrangian. Regarding 02 , the tan¬ 
gent space at (t, z) € ^2 is parameterized according to 

{6t,1^2{z)St -f z'^it - ti{zo),zi(ti{zo),zo)){I + a{zo))z[{t,zo)Szo) 

with {St,6zo) € R X and where zq S . 5 fo is such that z = Z2{t — 

ti{zo), zi{ti{zo), zq)). For two such vectors vi, V2, 

da2{t,z){vi,V2) = {dp A dx — dH2{z)dt){vi,V2) 

= dpAdx{{I d- a{zo))z[{t,zo)SzQ,{I d- a{zo))z[it, Zo)Szq) 
= dpAdx{z[{t,zo)6zl,z[{t,zo)SzQ) 

because exp(ti^ 2 ) is symplectic and because 

Lemma 8. 

/ -I- cr(zo) S Sp(2n, R). 

Proof. For any z G R^", 

*(/ -I- Jz*z)J{I -d- Jz*z) = J — z*z d- z*z -\- z{lz^^*'z = J. 

0 

This proves the lemma because of the definition ^ of a{zo). □ 

One then concludes as before that a2 is closed using the fact that exp(titi) is 
symplectic and ^0 is Lagrangian. 


Step 4- Let {x, u) : [0,t/] —>■ X x [/ be an admissible pair. We first assume that 
X is of class and that its graph has only one isolated contact with n(Ei), 
at some point point (ti,a::(ti)). For x close enough to x in the ‘^'’-topology, 
this graph has a unique lift t !->■ {t,x{t),p{t)) in U . As a gluing at ti 
of two absolutely continous functions, z := {x,p) : [0,tf] -A T*X is absolutely 
continous. Denote 71 and 72 the two pieces of this lift. Denote similarly and 
72 the pieces of the graph of the extremal z (see Fig. [^. One has 



f{x{t),u{t))dt = 


> 

d- 


{p{t)x{f) - H{x{t),p{t),u{t)))dt 


{p{t)x{t) - Hi{x{t),p{t))) dt 


{p{t)x{t) - H 2 {x{t),p{t))) dt 




0/2 


since z{t) belongs to for t G [0, ti) {resp. to O 2 for t G (<i, </]). By connected¬ 
ness, there exists a smooth curve 712 C Si connecting {ti,z{ti)) to (ti,z(fi)); 
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Figure 2: Integration paths. 


having the same endpoints, 71 and U 712 {resp. 72 and —712 U 72 ) are homo¬ 
topic. Since ai and 02 are exact one forms on and Jf 2 , respectively, 






since Hi = H 2 on S. 

Step 5. Consider finally an admissible pair {x,u), x close enough to x in the 
“i^^-topology. One can find x of class arbitrarily close to x in the 
topology such that 2:(0) = Xq and x{tf) = xj. Moreover, as n(Ei) is a locally 
a smooth manifold, up to some '^^-small perturbation one can assume that the 
graph of X has only transverse intersections with n(Ei). Let 'z := (a;, ^ denote 
the associated lift; one has 


f{x{t),u{t)) = {p{t)x{t) - H{x{t),p{t),u{t))) -fp{t){f{x{t),u{t)) - x{t)), 


and the second term in the right-hand side can be made arbitrarily small when 
X gets closer to x in the W^’°°-topology since {t,z{t)) = n“^(<,a:(t)) remains 
bounded by continuity of the inverse of 11. Let then e > 0; as a result of the 
previous discussion, there exists x of class with same endpoints as x and 
whose graph has only isolated contacts with n(Si) such that 
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[ fixit),u{t))dt> [ {p{t)x{t) - H[x(t),p{t),u{t)))dt-e. 

Jo Jo 

One can extend straightforwardly the analysis of the previous step to finitely 
many contacts with n(Si), and bound below the integral in the right-hand side 
of the second inequality by the cost of the reference trajectory. As e is arbitrary, 
this allows to conclude. □ 

4 Numerical example: The two-body potential 

Following [13) . we consider the two-body controlled problem in dimension three. 
Restricting to negative energy, orbits of the uncontrolled motion are ellipses, 
and the issue is to realize minimum fuel transfer between non-coplanar orbits 
around a fixed center of mass. The potential is V{q) := —p/\q\ defined on 
(5:={g€R^ I q ^ 0}, and we actually restrict to 

X := {(g, v) GTQ \ |up/2 - p/\q\ <0, g A u > 0}. 

(The last condition on the momentum avoids collisional trajectories and ori¬ 
entates the elliptic orbits.) The constant p is the gravitational constant that 
depends on the attracting celestial body. To keep things clear, a medium thrust 
case is presented below; the final time is fixed to 1.3 times the minimum time, 
approximately, which already ensures a satisfying gain of consumption |13j . In 
order to have fixed endpoints to perform a conjugate point test according to 
result, initial and final positions are fixed on the orbits (fixed longitude^. A 
more relevant treatment would leave the final longitude free (in accordance with 
assumption (ii) on the target in this would require a focal point test that 
could be done much in the same way (see, e.g., 0). See Tab. [^for a summary 
of the physical constants. 

As explained in the L^-minimization results in a competition between 
two Hamiltonians: Hq (coming from the drift, only), and Hq -|- Hi (assuming 
the control bound is normalized to 1 after some rescaling). Both Hamiltonians 
are smooth and fit in the framework set up in (j^to check sufficient optimality 
conditions. Restricting to bang-bang (in the norm of the control) extremals, 
regularity of the switchings is easily verified numerically, while normality is 
taken care of by Proposition [l] Then one has to check the no-fold condition on 
the Jacobi fields. The optimal solution (see Fig.[^ and these fields are computed 
using the hampath software m ; as in mm, a regularization by homotopy is 
used to capture the switching structure and initialize the computation of the 
bang-bang extremal by single shooting. We are then able to check condition 
(A2) directly on this extremal by a simple sign test (including the jumps on 
the Jacobi fields at the regular switchings) on the determinant of the fields (see 
Fig. 1^. An alternative approach would be to establish a convergence result as 
in m, and to verify the second order conditions on the sequence of regularized 
extremals. As underlined in fj^and (0 conjugate times may occur at or between 

^Precisely, the longitude I is defined as the sum of three broken angles: I = Q. -\- 6 -\- 
where Q. is the longitude of the ascending node (first Euler angle of the orbit plane with the 
equatorial plane; the second Euler angle defines the inclination of the orbit), 9 is the argument 
of perigee (angle of the semi-major axis of the ellipse, equal to the third Euler angle of the 
orbit plane), and vj is the true anomaly (polar angle with respect to the semi-major axis in 
the orbit plane). Here, Q = 0 = 0 on the initial and final orbits. 
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Table 1: Summary of physical constants used for the numerical commputation. 


Gravitational constant p 

of the Earth: 

398600.47 Km^’s"^ 

Mass of the spacecraft: 

1500 Kg 

Thrust: 

10 Newtons 

Initial perigee: 

Initial apogee: 

Initial inclination: 

Initial longitude: 

6643 Km 
46500 Km 
0.1222 rad 

TT rad 

Final perigee: 
Final apogee: 

Final inclination: 
Final longitude: 

42165 Km 
42165 Km 

0 rad 
56.659 rad 

Minimum time: 

110.41 hours 

Fixed final time: 

147.28 hours 

cost achieved (normalized): 


67.617 


switching times. On the example treated, no conjugate point is detected on 
ensuring strong local optimality. The extremal is then extended up to 
3.51/, and a conjugate point is detected about 3.21/, at a switching point (sign 
change occurint at the jump). A second test is provided Fig. by perturbing 
slightly the endpoint conditions, one observes that conjugacy occurs not at a 
switching anymore, but along a burn arc. 

Remark 1. As Hq is the lift of a vector field, the determinant of Jacobi fields 
is either identically zero or non-vanishing along a cost arc (p = 0). (Compare 
with the case of polyhedral control set; see also Corollary 3.9 in [2D]-) Moreover, 
coming from a mechanical system, the drift Fq is the symplectic gradient of the 
energy function, 

E{q,v) ■- ]^\v\^ FV{q). 

Accordingly, the 5x = {6q,6v) part of the Jacobi field (see appendix) along an 
integral arc of verifies 

6x(t) = 1^' {x{t))Sx{t), 

so Sx has a constant determinant along such an arc since the associated flow 
is symplectic. In particular, the disconjugacy condition (A2) implies that the 
optimal solution starts with a burn arc. 


Conclusion 

We have reviewed some of the particularities of L^-minimization in the control 
setting. Among these, the existence of singular controls valued in the interior 
of the Euclidean ball comes in strong contrast with the finite dimensional case. 
Moreover, these singular extremals are at least of order two, entailing existence 
of chattering |29|. By changing coordinates on the control, one can reduce the 
system to a single control, namely the norm of the original one. This emphasizes 
the role played by the Poisson structure of two Hamiltonians, the second not the 
lift of a vector field; this fact accounts for the possibility of conjugacy happening 
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Figure 3: minimum trajectory. The graph displays the trajectory (blue line), 

as well as the action of the control (red arrows). The initial orbit is strongly 
eccentric (0.75) and slightly inclined (7 degrees). The geostationary target orbit 
around the Earth is reached at t/ ~ 147.28 hours. The sparse structure of the 
control is clearly observed, with burn arcs concentrated around perigees and 
apogees (see [E]). The minimization leads to thrust only 46% of the time. 


not necessarily at switching times, as opposed to the simpler case of bang-bang 
controls valued in polyhedra. Sufficient conditions for this type of extremals 
have been given; they rely on a simple and numerically verifiable check on the 
discontinuous Jacobi fields of the system. They are essentially equivalent to the 
no-fold conditions of m, formulated here in a Hamiltonian setting. The exam¬ 
ple of L^-minimization for the three-dimensional two-body potential illustrates 
the interest of the approach. Future work include the treatment of mass varying 
systems (that is of maximization of the final mass) for more general problems 
such as the restricted three-body one. 

A Sufficient conditions in the smooth case 

Consider the same minimization problem as in Suppose that 
(BO) The reference extremal is normal. 

Having fixed to —1, we make the stronger assumption that the maximized 
Hamiltonian is well defined and smooth, and set 

h{z) := max H{z, ■), z€T*X. 

Scholium. For almost all t G [0,t/], 

h'm) = y^h{z{t)) - xiHimMt)) > o. 

Proof. For a.a. t G [0,t/], h{z{t)) — H{z{t),u{t)) = 0, while 
h{z) - H{z, u{t)) >0, zGT*X, 

by definition of h. Applying the first and second order necessary conditions for 
optimality on T*X at z = z{t) gives the result. □ 












-minimization for mechanical systems 


18 



0 50 100 150 200 250 300 350 400 450 500 


Figure 4: Conjugate point test on the bang-bang L^-extremal extended to 
[0,3.5t/]. The value of the determinant of Jacobi fields § along the extremal 
is plotted against time on the upper left subgraph. The first conjugate point 
occurs at tic — 475.93 hours > t/; optimality of the reference extremal on [0, t/] 
follows. On the upper right subgraph, a zoom is provided to show the jumps on 
the Jacobi fields (then on their determinant) around the first conjugate time; 
several jumps are observed, the first one leading to a sign change at the con¬ 
jugate time. Note that in accordance with Remark the determinant must 
be constant along the cost arcs (p = 0) provided the symplectic coordinates 
X = {q,v) are used; this is not the case here as the so called equinoctial ele¬ 
ments [To] are used for the state—hence the slight change in the determinant. 
The bang-bang norm of the control, rescaled to belong to [0,1] and extended to 
3.51/, is portrayed on the lower graph. On the extended time span, there are 
already more than 70 switchings though the thrust is just a medium one. For 
low thrusts, hundreds of switchings occur. 


We make the following assumption on the smooth reference extremal. 

(Bl) dx/dpo{t,Zo) is invertible for t G (0,t/]. 

Theorem 3. Under assumptions (BO)-(Bl), the reference trajectory is a ‘^°- 
local minimizer among all trajectories with same endpoints. 
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Figure 5: Conjugate point test on a perturbed bang-bang L^-extremal extended 
to [0, 3.5 </]. The value of the determinant of Jacobi fields (|^ along the extremal 
is plotted against time (detail on the right subgraph). The endpoint conditions 
xo, Xf given in Tab. [^are perturbed according to x x -\- Ax, |Ax| ~ le — 5, 
leading to conjugacy not at but between switching points—along a burn arc 
(p = 1). The first conjugate point occurs at tic — 489.23 hours > tf, ensuring 
again optimality of the reference extremal on 


Note that no Legendre type assumption is made, and that the disconjugacy con¬ 
dition (Bl) can be numerically verified {e.g., by a rank test while integrating the 
variational system along the reference extremal). For the sake of completeness, 
we provide a proof that essentially goes along the lines of D §21]. 

Proof. For Sq symmetric of order n, Lq := {feo = S'oJpo} is a Lagrangian 
subspace of Tzg{T*X). Denote by Sz = {6x,Sp) the solution of the linearized 
system 

5z(t) = h'{z{t))Sz(t), 6z{0) = (So, I), 

and set 5z{t) = {5x{t),Sp{t)) := ^f^6z{t) where is the fundamental solution 
of the linearized system 

=-^{z{t),u{t))^t, $0 = 4 . 

As Sp{0) = Jp(0) = I, 

S{t) := 6x{t)Sp(t)~^ 

is well defined for small enough t > 0. Since 

Lt:=exp{tfiy{z{t)){Lo) and 

are Lagrangian as images of Lq through linear symplectic mappings, S{t) must 
be symmetric. 

Lemma 9. S{t) > 0 
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Proof. Let > 0 such that S{ti) is well defined, and let f € R". Set 
:= and Szi{t) := dz{t)fo. 

Then (52^1 (ti) = and(5a;i(t) = S{t)6pi{t). Differentiating the previous 

relation and using S{t) symmetry leads to 

{S{t)6pi{t)\6pi{t)) = uj{6zi{t),Szi{t)). 

Differentiating now 

Szi{t) = ^f^dz{t)fo, 

one gets 

_V ffu 

6i,{t) = 

= j‘$t(V^/i(z(t)) - Vl^H(z(t),u{t)))^tSzi{t). 

" -V-^ 

> 0 

(J denotes the standard symplectic matrix.) Evaluating at t = ti, one eventually 
gets >0. □ 

For Sq = 0, there is p > 0 such that S{t) is well defined on [0, p], which remains 
true for So > 0, |S'o| small enough. By the lemma before, S'* > 0 on [0,77]. In 
particular, it is an invertible matrix, which ensures that is transversal 

to ker7r'(zo) (tt : T*X —>• X being the canonical projection), that is Lt is 
transversal to ker7r'(z(t)) by virtue of 

Scholium. $i(ker7r'(zo)) = ker7r'(z(t)) 

Proof. Note that in the linearized system defining 

Sx{t) = XlpH{z{t),u{t))Sx{t), 

6p{t) = -Vl^H{z{t),u{t))Sx{t)-Vl^H{z{t),u{t))6p{t), 

the equation on Sx is linear. Hence Jx(0) = 0 implies Sx = 0. □ 

By restricting if necessary |S'o|, (Bl) allows to assume that Sx(t) remains in¬ 
vertible for t e [p,tf], so transversality of Lt holds on [0,t/]. As a result, one 
can devise a Lagrangian submanifold L£o of T*X whose tangent space at zq is 
Lq; then 

:= {(t, z) G R X T*X \ (3zo G -Sfo) : t G {—s,tf + e) s.t. z = exp(t7^)(zo)} 

is well defined for £ small enough, and such that n:Rxr*A—>'RxA induces 
a diffeomorphism from J/f onto its image. One can moreover choose .ifo such 
that pdx is not only closed but an exact form on it, in order that the Poincare- 
Cartan form pdx — h{z)dt is exact on .if. This, together with assumption (BO), 
allows to conclude as usual that the reference trajectory is optimal with respect 
to ‘^^-neighbouring trajectories with same endpoints. □ 
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